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£^ the device which along with associated filtering circuitry enables the voice communication to be used to affect the operation of the 
device or recorded for later playback. 
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IMPLANT ART ,E MEDIC AT DEVICE WITH VOICE 
RESPONDING AND RECORDING CAPACITY 

Cross-Reference to Related Applications 

This application is a continuation-in-part of U.S. Patent Application No. 
09/421,746, filed on October 20, 1999, which is incorporated herein by 
reference. 

5 Field of the Invention 

This invention pertains to implantable medical devices and to methods 
and systems for operating same. In particular, the invention relates to means for 
communicating with such devices. 

Background 

10 Modem pacemakers typically have the capability to communicate data 

via a radio-frequency link with an external programming device. Such data is 
transmitted to the pacemaker in order to program its mode of operation as well as 
define other operating parameters. Data transmitted from the pacemaker can be 
used to verify the operating parameters as well as relay information regarding the < 

1 5 condition of both the pacemaker and the patient. Pacemaker patients are 

monitored at regular intervals as part of routine patient care and to check the 
condition of the device. Among the data which may typically be telemetered 
from the pacemaker are its programming parameters and an electrogram 
representing the electrical activity of the heart as sensed by the pacemaker. 

20 Pacemakers have also been developed which monitor certain parameters over 
time while the device is functioning in the patient. Data representing these 
parameters can be stored in memory for later retrieval using an external 
programmer. 

Summary of the Invention 

, 25 It would be desirable in certain situations to be able to communicate with 

an implantable medical device such as a pacemaker without the need for an 
external programming device or any kind of equipment such as a radio 
transmitter/receiver. This would enable a patient, for example, to alter the 
operation of the device by such communication at any time or place as the need 

1 



BNSDOCID: <WO 012B627A1_I_> 



WO 01/28627 PCT/USOO/41215 

arises. Furthermore, the data recording capabilities of the implantable medical 
device could be activated by the patient whenever subjective symptoms are 
noted. The recorded data could then be retrieved later and analyzed for 
correlation with the symptoms experienced by the patient. 
5 Accordingly, in one embodiment, the present invention is an implantable 

medical device, such as a cardiac pacemaker or implantable 
cardioverter/defibrillator, having incorporated therein a system enabling voice 
communication with the device so that the device responds to voice commands. 
The system includes an acoustic transducer and processing circuitry for sensing a 

10 patient's voice and deriving messages from words spoken by the patient, which 
messages may then alter the operation of the device. When a patient in whom 
the device is implanted speaks, the vibrating chords of the larynx cause 
acoustical energy to be radiated into the thorax where the acoustic transducer 
converts the energy into electrical audio signals. The audio signals can be 

1 5 analyzed with speech recognition circuitry to recognize certain words that 

correspond to system messages which are then employed to affect the operation 
of the device. In certain embodiments of the device, the patient's spoken 
commands can be used to alter the operating mode of a pacemaker, change 
operating parameters, or initiate recording of physiological data for later 

20 retrieval. Such recorded data can include, for example, electrograms, recordings 
of the patient's voice, heart sounds, respiratory patterns, or indications of 
physical activity. 

In another embodiment, the invention is an implantable medical device, 
such as a cardiac pacemaker or implantable cardioverter/defibrillator, having 

25 incorporated therein a system enabling voice recording by the device, with the 
voice recording activated by either an external or internal signal. In the case of 
externally activated voice recording, the external signal may be, e.g., a voice, 
tactile, or magnetic signal imparted to the device by the patient or physician. An 
internal signal may be generated by the device upon sensing a particular 

30 physiological condition via its sensing channels, where the particular condition 
would typically be defined as one where it would be useful to have the subjective 
impressions of the patient while the condition is present, such as during an 
arrhythmic episode. 
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Prief Descr iption of the Drawings 

Fig. 1 is a system diagram of an implantable medical device 
incorporating the invention. 

Description of the Invention 
5 This application hereby incorporates by reference U.S. Patent 

Application No. 09/306,605, filed on May 6, 1999, in its entirety. 

In the description that follows, a microprocessor-based pacemaker will be 
referred to as incorporating the present invention. It should be appreciated, 
however, the invention could also be incorporated into a pacemaker controlled 

10 by custom logic circuitry either in addition to or instead of a programmed 

microprocessor. The term "circuitry" as used herein should therefore be taken to 
mean either custom circuitry or a microprocessor executing programmed 
instructions contained in a processor-readable storage medium along with 
associated circuit elements. 

15 Fig. 1 shows a system diagram of an implantable medical device, in this 

case is a microprocessor-based pacemaker with defibrillation and/or 
antitachycardia pacing capability, that incorporates the present invention. A 
microprocessor 1 0 communicates with a system memory 1 2 via a bidirectional 
system bus. Memory 12 may typically comprise a ROM for program storage 

20 and a RAM for data storage. The overall operation of the device is controlled by 
a system program running from the memory 12. The microprocessor also has a 
port for communicating with the telemetry interface 40 which in turn receives 
programming data from and transmits telemetry data to an external programmer 
70 by a radio link. The pacemaker has atrial sensing and pacing channels 

25 comprising electrode 34, lead 33, sensing amplifier 31, pulse generator 32, and 
an atrial channel interface 30 which communicates bidirectionally with a port of 
microprocessor 10. The ventricular sensing and pacing channels similarly 
comprise electrode 24, lead 23, sensing amplifier 21 , pulse generator 22, and a 
ventricular channel interface 20. For each channel, the same lead and electrode 

30 are used for both sensing and pacing. The channel interface includes sampling 
circuitry and an analog-to-digital converter for digitizing sensing signal outputs 
from the sensing amplifiers and registers which can be written to by the 
microprocessor in order to control pacing. A shock pulse generator 80 can also 
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be interfaced to the microprocessor for delivering cardioversion or defibrillation 
pulses to the heart via a separate pair of electrodes 81a and 81b. Power for the 
device is provided by a battery. 

An acoustic transducer 50 communicates with the microprocessor via a 
5 transducer interface 5 1 . The transducer 50 may be an accelerometer or other 
piezo-resistive device capable of transducing acoustical energy from the patient's 
body into electrical signals. When the implantable medical device is implanted 
into a patient, the transducer 50 is capable of producing audio signals 
corresponding to the patient's voice, as acoustical energy produced by the 

10 patient's larynx is radiated into the thorax as well as into the air. The transducer 
interface 51 includes sampling circuitry for sampling the acoustic transducer 
output, an analog-to-digital converter for digitizing the samples, and circuitry for 
interfacing to a digital signal processor 53. Filtering of the transducer signals 
may also be performed by analog filters in the transducer interface 51 prior to 

15 digitization to reduce aliasing effects. 

The digital signal processor interfaces to the microprocessor via the 
system bus and may incorporate speech recognition circuitry for extracting 
speech information from the digitized transducer signals. Such speech 
information may constitute specific groups of words that can be decoded into 

20 messages recognized by the system program. When such words are spoken by 
the patient, the messages cause the system program to alter the operation of the 
pacemaker. In different embodiments, a message derived from the speech 
information may cause the system program to alter the operation of the 
pacemaker by, for example, changing its operating mode, changing the operating 

25 parameters such as minimum heart rate, or causing the pacemaker to begin 
storage of sampled data in a storage medium such as the system memory 12. 

Examples of such data storage include samples of the acoustic transducer 
output which therefore constitute recordings of the patient's voice or heart 
sounds, and samples of the sensing channel outputs thus forming a cardiac 

30 electrogram. Time stamps may also be applied to the recordings as they are 

made. Other types of data as recorded by other physiologic sensors incorporated 
into the device could also be recorded. The recordings can be later retrieved by 
transmission via the telemetry interface to an external programming device. 

4 
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Such recordings of physiological or voice data can then be correlated with 
symptoms experienced by the patient. This may be very useful to a treating 
physician in getting an accurate history of a cardiac event experienced by the 
patient, especially for those patients who are not able to adequately describe a 
5 cardiac event at much later clinical visit. 

In another embodiment, voice recording is initiated upon receipt by the 
device of either an externally derived signal or an internal signal generated by 
the device itself. Examples of such external signals that could be used by 
particular embodiments are voice commands sensed and interpreted by the 

10 device as described above, operation of a magnetically-actuated reed switch with 
a magnet placed in proximity to the device (as is done to initiate a programming 
mode in conventional pacemakers), or manual operation of tactilely actuated 
switch by a user. In the case of a tactilely actuated switch, the tactile sensor 
actuating the switch could be, for example, a button placed on the outside of the 

1 5 implanted device which a user could access by pressing on the overlying skin, or 
a vibration sensor or accelerometer such as acoustic transducer 50 where 
acoustic signals generated by tactile stimuli applied to the device (e.g., by 
manually tapping) are interpreted as commands to activate voice recording. In 
another embodiment, voice recording could be activated when an internal signal 

20 is generated by the device when a condition corresponding to the onset of a 
physiologic or cardiac event is sensed by the device. In other embodiments, 
such externally and internally generated signals can be used to trigger other types 
of diagnostic storage including, e.g., recording of time stamps, cardiac 
electrograms, activity sensor outputs, and heart sound sensors, as well as to 

25 affect the operation of the device such as adjusting the pacing rate within 

predefined limits or turning on or off sensor dependent rate-responsive features. 

In order to derive speech information from the acoustic transducer output 
corresponding to the patient's voice or to produce intelligible voice recordings 
for later playback, the acoustic transducer output must be sampled at some 

30 minimum rate. As both processor overhead and the memory requirements of the 
system increase with the sample rate, it is desirable to sample near this 
minimum rate. Although human hearing is capable of detecting audio 
frequencies up to 20 KHz, only a fraction of that bandwidth is needed to transmit 
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normal speech. Phone lines in the U.S., for example, restrict the bandwidth of 
transmitted audio signals to below 4 KHz in order to prevent aliasing distortion 
when the signals are digitized. A level 0 digital signal used for transmitting a 
single voice channel over phone lines in the U.S., for example, is a pulse code 
5 modulated signal consisting of an analog voice signal sampled with 8 bits of 
quantization at a rate of 8000 samples per second. It has been found that 
intelligible speech can still result if an audio signal is bandlimited to. at least as 
low as 2 KHz, which implies a minimum sampling rate of 4000 samples per 
second. At 4000 samples per second, a memory requirement of 80 Kilobytes 
10 would be needed for a 20 second recording. This figure can be reduced still 
further using various data compression techniques. 

The implantable medical device as described thus enables a patient to 
affect the operation of the device with voice commands. In order to prevent 
inadvertent commands being issued to the device and restrict access to its voice 

1 5 control feature, the system could be programmed to ignore all messages derived 
from transduced speech unless a specific password is first spoken. Another 
password could be used to cause further speech to be ignored. Alternatively, the 
voice control feature could be rendered inactive until a specific input signal is 
received which could be, for example, operation of a reed switch by a magnetic 

20 field similar to the way external programmers typically communicate with 
pacemakers, or operation of a tactile sensor incorporated into the device. 

Although the invention has been described in conjunction with the 
foregoing specific embodiment, many alternatives^ variations, and modifications 
will be apparent to those of ordinary skill in the art. Such alternatives, 

25 variations, and modifications are intended to fall within the scope of the 
following appended claims. 



6 
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What is claimed is: 

1 . A medical device adapted for implantation into a patient, comprising: 
an acoustic transducer for receiving acoustic energy from within the 

patient's body and generating electrical audio signals in accordance therewith; 

sampling circuitry and an analog-to-digital converter for producing 
digitized samples of a signal received from the acoustic transducer; . 

speech processing circuitry for analyzing the digitized signal and 
deriving a message therefrom; and 

circuitry for interpreting the received message and altering the operation 
of the device in accordance therewith. 

2. The device of claim 1 wherein the message interpreting circuitry ignores 
all messages until a message corresponding to a spoken password is received. 

15 

3. The device of claim 1 further comprising: 

a sensing channel for sensing electrical activity of a patient's heart in 
whom the device is implanted; 

circuitry for producing digitized samples of the sensed electrical activity; 

20 and 

circuitry for recording of a plurality of the digitized samples of the sensed 
electrical activity in a storage medium when a selected message is received. 

4. The device of claim 1 further comprising circuitry for recording a time 
25 stamp when a selected message is received. 

5. The device of claim 1 further comprising circuitry for enabling the coded 
message to cause recording of a plurality of samples of the digitized acoustic 
signals in a storage medium. 

30 

6. The device of claim 5'further comprising telemetry circuitry for 
transmitting the plurality of samples recorded in the storage medium to an 
external programming device. 

7 
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7. The device of claim 1 wherein the implantable medical device is a 
cardiac device selected from a group consisting of a cardiac pacemaker, an 
implantable cardioverter/defibrillator, and a combination pacemaker/defibrillator 
and further comprising circuitry for enabling messages derived from the 
5 digitized audio signals to alter operating parameters of the device. 



8. The device of claim 1 further comprising circuitry for deactivating 
processing of audio signals until an activation signal is received. 

10 9. The device of claim 8 wherein the activation signal is operation of a reed 
switch by a magnetic field. 

10. The device of claim 8 wherein the activation signal is operation of a 
tactile switch incorporated into the device. 

15 

11. A medical device adapted for implantation into a patient, comprising: 
an acoustic transducer for receiving acoustic energy from within the 

patient's body and generating electrical audio signals in accordance therewith; 
sampling circuitry and an analog-to-digital converter for producing 
20 digitized samples of a signal received from the acoustic transducer; and 

circuitry for recording of a plurality of samples of the digitized acoustic 
signals in a storage medium. 

12. The device of claim 8 wherein the recording circuitry is activated to 
25 initiate voice recording by operation of a magnetically actuated reed switch. 

13. The device of claim 8 wherein the recording circuitry is activated to 
initiate voice recording by operation of a tactile switch incorporated into the 
device. 

30 

14. A method for controlling the operation of an implantable medical device 
comprising: 

receiving acoustic energy within a patient's body and generating 

8 
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electrical audio signals in accordance therewith; 

analyzing the audio signals and deriving a message therefrom; and 
interpreting the message and altering the operation of the device in 

accordance therewith. 

5 

15. The method of claim 14 further comprising sampling and digitizing the 
audio signal prior to analyzing the samples to derive a message therefrom. 

16. The method of claim 1 5 further comprising initiating storage of a 

10 plurality of digitized audio signal samples upon receipt of a selected message. 

17. The method of claim 14 comprising: 

sensing electrical activity of a patient's heart in whom the device is 
implanted; 

15 producing digitized samples of the sensed electrical activity; and 

recording a plurality of the digitized samples of the sensed electrical 
activity in a storage medium when a selected message is received. 

18. The method of claim 14 further comprising ignoring all messages 
20 received until a message corresponding to a spoken password is received. 

19. The method of claim 14 further comprising deactivating processing of 
audio signals until an activation signal is received. 

25 20. The method of claim 19 wherein the activation signal is operation of a 
reed switch by a magnetic field. 

21 . The method of claim 20 wherein the activation signal is operation of a 
tactile switch incorporated into the device. 



9 
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